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GING SYSTEM WITH BUILT-IN DIAGNOSTICS 

BACKGRQinc p OF THE JKVENTinK 

Field of the Invention 

— *- "Cia oi image sensors and umging systems. 

DescriptiQn of the Related Art 

An integrated image sensor is used to convert light impinging on the sensor into electrical signals. An 
image sensor typicaUy includes one or more (e.g., an airay of) photoelcidents such as photodiodes, 
photoiransistor^, or other types of photodetectois. where electrical signals are generated via the weIl-kno^vn 
photoelectric effect. These signals may then be used, for example, to provide information about light intensity, 
color, or the optical image focused on the sensor. One common type of image sensor is a CMOS image 
sensor. 

Fig. 1 shows a schematic top view of a CMOS image sensor 100 implemented in a single integrated 
15 circuit or chip. Sensor 100 comprises a photoelement array 102. a decoding/buffer area 104, and control, 

Focessing. and input/ output (I/O) circuitry 106. Photoelement array 102 comprises an array of photoelements 
and associated circuitry such as switches and ampUfiers. Each photoelement and its associated circuiby are 
collectively referred to as a pixel, linage sensore, such as sensor 100. maybe used in imaging systems, such as 
digital cameras. 

10 Testing and manufacturing yield can have a substantial influence on the ultimate cost of a chip. 

Testing is done to detect circuit defiscts to prevent customer returns. Ideally, the defects are detected early in 
the manufacturing process to avoid unnecessary fabrication costs for defective chips. Often, such testing is 
carried out using high-speed testing systems on the bare die on a wafer before the circuit is packaged. 

Fig. 2 shows a schematic block diagram of a typical testing system 200 that can be used for testing 

5 image sensors, such as sensor 100 of Fig. 1 , prior to packaging. Testing system 200 comprises a testing 

platform 202, a controller 204, a power supply 206, and a stimuli generator 208. The device under test (DUT), 
in this particular case, unpackaged image sensor wafer 100, is mounted on platform 202, which comprises 
control and support circuitry 210 and an interface 212. Controller 204 is a software-driven device that controls 
platform 202, supply 206, and generator 208. Generator 208 is a calibrated light source that provides optical 
input for sensor 100 when instructed to by controller 204. Controller 204 performs a specific test function on 
sensor 100 usmg interface 212 and circuitry 210. The overall test procedure may have a sequence of such 
functions. Conlroller 204 receives test data generated by sensor 100 through interface 212, analyzes the data, 
and determines if sensor 100 performed according to the specifications using a set of predetermined criteria 
stored in the controller's memory. If the criteria are satisfied, then sensor 100 is marked for later packaging. If 
the criteria are not satisfied, then the sensor is marked defective and is usuaUy discarded. 



PiXIM 048/1 19 



1039.017 



A prcblcm with ^proach is that testing on the bare die maySJevcal aU ckfective sensois. 
Unlike many other integrated circuits, integrated image sensors, such as sensor 1 00, due to certain specific 
characteristics, also have to be tested after final assenibly. For example, an image semor should be fiee of (1) 
optical obstmctions in the photosensitive area and (2) optical system defects, such as microlens defects. These 

types of defects can be detected '^^-i^-^ «u^« i i ^ j 

jx- — wAAij M^Lw uiw viiip uaa uCCn packaged. 

To accommodate this requirement, a test procedure may involve multiple testing stages. For example, 
in a first testing stage, often referred to as prescrcening, a fest relatively simple test is performed on an 
unpackaged sensor, for example, using the testing system of Fig. 2. TTie sensoni that fail the prescreening are 
discarded, while the sensors that pass the prescreening are packaged. In a second testing stage, a more 
comprehensive test is performed on each packaged device. As wth unpackaged sensors, packaged devices 
that fail the second testing stage are discarded. TTiis second testing stage is often implemented using a testing 
system functionally similar to testing system 200 of Fig. 2. However, in iWs case, the testing system is 
designed to simulate the operation of the packaged sensor in the final product. Consequently, testing systems 
for the prescreening and the second testing stage may need different equipment The expense of buUding 
multiple testing systems often precludes (1) the use of several testing systems in paraUel to speed up testing 
and'or (2) the use of duplicate testing systems at scparalB locations. Lastly, there is a need for testing once the 
sensor has been incorporated into the final system (e.g., a camera). This kind of test is often the most onerous, 
since the entire final product has to be placed under test, and the hardest to perform, since the sensor will be at 
that stage connected to the rest of the circuit and the control and diagnostics software might not yet be built 
into the final system. A system that can self test, detect errors, and eoixect such errors is not cwrcnUy 
available, and would be of great value to many businesses and industries. 

SUMMARY OF THE INVENTrpN 
The present invention provides an integrated system-on-a-chip (SOC) imaging system with built-in 
diagnostics. According to one inq>Iementation of the present invention, an imaging system can be operated in 
two operating modes: a normal operating mode and a diagnostic mode. While running in the diagnostic mode, 
the imaging system can be configured to detect manufacturing defects for identifying defective chips. In 
certain embodiments, the imaging system can be fijrther configured to compensate for certain types of 
manufacturing defects. While running in the diagnostic mode, the imaging system (1) identifies pixels that 
function incoirectly and (2) creates a record of such pixels. In the nonnal operating mode, the imagmg system 
can use the record to compensate for the missing or incorrect data fhnn these defective pixels during real-time 
image processing. Tlie present invention simplifies testing of image sensois by providing an SOC image 
sensor that can be tested one time using a relatively simple testing system as opposed to the relatively complex 
multi-stage multi-system testing of the prior art. It also increases manufacturing yield by providing 
condensation for certain types of sensor defects and, therefore, results in lower per-unit manufacturing cost. 
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According to on^fcjdiinent, the present mventi.„ is an iinag^tcm comprising an image 
sensor, * memory, and a processor, wherein the image sensor is configured to generate image signals 
corresponding to an image of a scene; the memory is configured to store image data corresponding to the 
image signals; and the processor is configured to control operations of the itnaging system in a diagnostic 
mode and in a normal operating mode, -wherein, during the diagnostic mode, the processor analj^eTthe^image 
data to determine if the image sensor is defective. 

According to another embodmjent. the present invention is a method for fiibricating an imaging system 
comprising the steps of (a) fanning an image sensor configured to generate image signals corresponding to an 
image of a scene; (b) forming a memory configured to store image data corresponding to the image signals; 
and (c) forming a processor configured to control operations of the imaging system in a diagnostic mode and in 
a normal operating mode, wherein, during the diagnostic mode, ihc processor analyzes the image data to 
determine if the image sensor is defective. 

According to yet another embodiment, the present invention is an imaging system comprising an 
image sensor, a memory, and a processor, wherein the image sensor is configured to generate image signals 
corresponding to an image of a scene; the memory is configured to store image data corresponding the image 
signals; and the processor is configured to control opeiations of the imaging system in a normal operating 
mode, wherein, during the normal operating mode, the processor processes the image data to compensate for 
one or more defective pixels in the image sensor. 

BRIEF DESC fiIPTTO>f OF THE DRAWPJnS 
Other aspects, features, and advantages of the present invention will become more ftxUy apparent fiom 
the following detailed description, the appended claims, and the accompanying drawings in which: 
Fig. 1 shows a schematic top view of an integrated CMOS image sensor of the prior art; 
Fig. 2 is a schematic block diagram of a testing system of the prior art; 

Fig. 3 shows a schematic block diagram of an imaging system according to one embodiment of the 
present invention; 

Fig. 4 is a schematic block diagram of an image sensor that may be used in the system of Fig. 3; 
Fig. 5 shows a schematic block diagram of one implementation of a testing system to test the imaging 
systemof Fig. 3; 

Fig. 6 shows a schematic block diagram of an alternative implementation of a testing system to test a 
plurality of imaging systems; and 

Fig. 7 is a flowchart illustrating a metliod of detecting and compensating for manufactarring defects in 
tiie imaging system of Fig. 3 according to one implementation of the present invention. 
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DETAn.Fn DESCRiPTrrnv 
Reference herein to "one en,bodiment" or "an embodiment" mean, that a particular feature, stnicture 
or charact^nstc described in connection with the embodiment can be included in a, least one embodiment of 

the invention The 

,r , y,^^^ ^ emooQunent m vanous places in the speciiication are 

not necessarily aU nrfemng to the same embodiment, nor are separate or alternative embodiments mun«lly 
exclusive of other embodiments. Tie description herein is largely based on a particular imaging system based 
on CMOS technology and system-on-a^hip (SOC) imaging system architecture. TTiose skilled in the art can 
appreciate that the description can be equally applied to other imaging systems. 

Fig. 3 shows a schematic block diagram of an imaging system 300 according to one embodiment of the 
present invention. System 300 comprises a digital image sensor 302, an onndiip memory 304. a processor 
306, a register 308, and a read<mly memory (ROM) 310. all implemented on a single chip as an SOC. Sensor 
302 is configured to generate digital image data in response to incident hght and transfer the data :o memory 
304. Processor 306 is configured to access and process the data stored in the memory. Data processing may 
include but is not limited to data interpolation, noise reduction, color adjustment, and/or geometric corrections 
due to optical aberrations. 

Fig. 4 shows a schematic block diagram of a digital pixel sensor (DPS) array that can be used as image 
sensor 302 of system 300. One particular implementation of image sensor 302 is described in U.S. Patent No. 
5,461,425 (Fowler et al.), (he teachings of which are incorporated herein by reference. Sensor 302 comprises 
an array 402 of photoelements and associated circuitry, such as switches and amplifiers. Each photoelemcnt 
and its associated circuitry are collectively refened tn as a pixel 404. Each pixel 404 of array 402 has a 
dedicated analog-to-digital converter (ADC) (not shown). In response to incident light, the photoelement in 
each pixel generates analog signals, such as current or voltage, representative of the light intensity. These 
analog signals are converted by the ADC in each pixel of array 402 into a serial bit stream and ttansferrcd via a 
corresponding bit hne 406. ADC outputs are synchronized using a common clock driver 408. Each clocked 
bit stream is then processed by filters 410 to derive a digital value representative of the intensity of hght 
incident on the corresponding pixel 404. Digital values can then be output from sensor 302 to memory 304 of 
Fig. 3 for storage and further processing via a control circuit 412 and bus 414. 

Referring again to Fig. 3, read-only memoiy 310 is configured to store internal bootable software. 
This software comprises normal operating routines and special diagnostic routines. These diagnostic routines 
simphfy test equipment for imaging system 300 since very minimal externa] support is required to cany out a 
testing procedure for system 300. Consequently, a testing system for system 300 can be significantly simpler 
compared lo prior art testing system 200 of Fig. 2. 

Fig. 5 shows a schematic block diagram of a testing system 500 that can be used to test imaging system 
300 of Fig. 3. Testing system 500 comprises a testing platform §02 having interface S12, a controller 504, a 
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power supply 506. and ai^i generator 508. GenenUor 508 is a calibil Ught source sinnlar to generator 
208 oftestmg system 200. li»aging system 300 (i.e., the DUT) is mounted on platform 502. Unlikeimagc 
sensor 100, which requites different testing system before and after packaging, imaging system 300 can be 
tested at different stages usmg a single testing system, such as testing system 500 of Fig. 5. Imaging system 
300 can be mounted on testing system 500 losing a rdar>.'=ly simple mount, e.g., a surface probe or ample 
socket. Consequently, platform 502 can have a relatively simple circuit board comprising power contacts and 
toggles for the pins of imaging system 300. 

Unhke the complex functions of controller 204 of testing system 200 of Fig. 2, controller 504 of 
testing system 500 has a simphficd funcrton of booting imaging system 300 into its diagnostic mode. This can 
be done by a variety of methods, such as supplying a voltage pattem of logical "0" and/or logical "1" values to 
one or more package pins of system 300. After imaging system 300 has been booted in the diagnostic mode, 
controller 504 communicates with it through interface 512. According to instructions received from processor 
306 of imaging system300. controller 504 steps generator 508 throudi a set of predetermined operations in 
synchronization with a diagnostic routine executed by processor 306. Data generated by image sensor 302 
1 5 during the diagnostic routine are processed and analyzed by processor 306 using a set of predetermined criteria 
stored, B.g., in ROM 310, to generate test results. The test results can be stored on-chip in system 300. e.g.. in 
register 308, and/or off-chip, e.g„ on a. magnetic disk (not shown). 

Due to fewer testing stages for testing imaging system 300, the relative sunpUcity of testing platform 
502, and the simplified functions of conHollcr 504, testing system 500 can be relatively simple and 
inexpensive compared to a typical testing system of the prior art, such as testing system 20O of Fig. 2. This 
makes it more economical to have multiple testing systems at one locahon to enable parallel testing of devices 
or to have such testing systems installed at multiple locations to enable post-manufacturing and/or customer 
quality control. 

Fig. 6 shows a schematic block diagram of an altemative testing system 600 that can be used for 
testing imaging systems, such as imaging system 300 of Fig. 3. Tesung system 600 is similar to testing system 
500 of Fig. 5, except that testing system 600 is configured to accommodate a plurality of DUTs, such as 
imaging system 300, as opposed to a single DUT for testing system 500. Testing system 600 is relatively 
simple because very minimal external support is required to carry out a testing procedure for each individual 
imaging system 300. Functions of controller 604 are similar to those of controller S04 of testing system 500. 
An additional responsibility of controller 604 compared to controller 504 is to synchronize certain steps in the 
diagnostic routines executed by each mdividual processor 306 of each individual imaging system 300 mounted 
for testing on system 600 with a single stimuli generator 608. Usmg testing system 600. parallel testing of 
multiple imaging systems, such as imaging system 300, can be implemented in a relatively simple and 
inexpensive way. 
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TTie manufkctur^eld of inage sensors, such as sensor 100, ^OC imaging systems, such as 
system 300. is typically conflated to pixel defects. Often, a large array (e.g., 512x5 12) of p«els in an image 
sensor or unaging system may have only a few pixels that do not perfonn according to the speaficalions. 
Often, such pixels are isolated. e.g.. each defective pixel ha. neighboring pixels that work properly. Ih an 
SOC implementation, an iinaging s-.-stem, such as s-ystem 300, be configured to compensate for this type of 
manufacturing defect using the test results generated during the diagnostic routine described above. Similar 
compensation processing may also be performed for non-SOC systems, including those implemented using 
prior art image sensoni, such as sensor 100 of Fig. I, that are tested using prior-art testing systems, such as 
system 200 of Fig. 2. This capability may substantially increase manufacturing yield of both SOC imaging 
systems and non-SOC image sensors and, thus, lower the per-unit cost. 

Fig. 7 shows a flowchart illustrating a method 700 of detecting and compensating for manu&cturing 
defects in an imaging system, such as system 300 of Fig. 3. according to one impleraortation. In step 702 of 
method 700, a packaged SOC imaging system 300 is mounted on a testing system, such as testing system 500 
of Fig. 5. and booted in its diagnostic mode. In step 704, imaging system 300 and testing system 500 are 
stepped throuiJi a diagnostic routine to generate a response pattern of image sensor 302. 

In step 706, the response pattem is analyzed by processor 306 to identify defective pixels, if any, in 
image sensor 302, and the addresses and characteristics of these pixels are recorded for use during subsequent 
real-time image processing. The recorded characteristics of a defective pixel may include, but are not hmited 
to. the deviation of "dark" counts (in the absence of Ught) from those in the specification, a fixed offset 
Opositive or negative), a light-intensity-to-digital-counts conversion factor, or the type of defect (e.g.. no data or 
pennanent saturation). In one embodiment of step 706 of method 700, the addresses of the defective pixels 
can be permanently recorded in register 308 of imaging system 300. Numerous other techniques can be 
employed to record the identity of such pixels. For example, in one embodiment, the pixel addresses can be 
recorded in a programmable read<»nly memory located on-chip, such as ROM 310 of system 300. hi an 
alternative embodiment, the pixel addresses can be recorded off-chip, e.g., on a magnetic disk. 

In the prior art, following the prescreening, the common practice is to discard defective unpackaged 
chips having certain types of defects. However, in view of the present invention and depending on the 
intended appHcation, defective unpackaged chips naay be sorted into categories according to the number and 
distribution of defects. Some categories of the defective unpackaged chips that are deemed conectable may be 
packaged. According to certain embodiments of the present invention, once the identity and characteristics of 
defective pixels, if any, have been recorded, in step 708, the packaged SOC imaging system 300 is configured 
mto a final product (e.g., a video camera or digital camera). Once the final product is assembled, imaging 
system 300 can be booted in its normal operating mode in step 710. In step 712, image-processing algoriflims 
can use the recorded information about defective pixels during the normal operating mode to compensate for 
the missing or inconect data from tiiese pixels. For example, the data for a defective pixel can be 
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approxnna^d ««ng ini^on of image data the neighboring pMor usmg other imag*.proccssing 
techniques. Smrilar real-time compensation for defective pixels can be implemented even for sensors or 
imaging systems that arc tested tising prior-art testing systems, such as system 200 of Fig. 2. 

hi general, the present invention may be implemented for imaging systems having image with 
.me or more pixels arranged in either a one- or two^imensional pattern, .ucb as an array of pixels arranged in 
rows and columns. Photoclements in each pixel may be based on any suitable light-semiitivc device, such as, 
for example, a photodiode, a phototransistor, aphotogate, photo-conductor, a charge-coupled device, a charge- 
transfer device, or a charge-injection device. Similarly, as used in this specification, the tenn "light" refeis to 
any suitable electromagnetic radiation in any wavelength and is not necessarily hmited to visible light 

While this invention has been described with reference to illustrative embodiments, this description is 
not intended to be construed in a hmiting sense. Various modifications of the described embodiments, as well 
as other embodiments of the invention, which are apparent to persons slrilled in ihe art to which the invention 
pertains are deemed to lie within the principle and scope of the invention as expressed in the following chums. 
For example, software enabling the diagnostic mode for an imaging system may be stored off-chip and loaded 
into the imaging system from the testing system during boot-up. 

Ahhough 4e present invention has been described with reference to digital image sensors and SOC 
imaging system architecture, it can also be practiced for analog image sensore. For an SCX: imaging system 
wifli an analog hnage sensor, the system may also need to include one or more analog-to-digilal convertere to 
convert the analog image signals into digital image data for storage in the memory. 

Although the steps in the following method claims, if any, are recited in a particular sequence with 
cortttsponding labeling, unless the claim recitations otherwise imply a particular sequence for implementing 
some or all of those steps, those steps are not necessarily intended to be hmited to being in?>lemented in that 
particular sequence. 
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